ON THE USEFULNESS OF PERSISTENT EXCITATION IN ARX 

ADAPTIVE TRACKING 



BERNARD BERCU AND VICTOR VAZQUEZ 

Abstract. The usefulness of persistent excitation is well-known in the control 
community. Thanks to a persistently excited adaptive tracking control, we show 
that it is possible to avoid the strong controllability assumption recently proposed 
in the multidimensional ARX framework. We establish the almost sure conver- 
gence for both least squares and weighted least squares estimators of the unknown 
parameters. A central limit theorem and a law of iterated logarithm are also 
provided. All this asymptotical analysis is related to the Schur complement of a 
suitable limiting matrix. 



1. INTRODUCTION 

The concept of persistent excitation is well-known in the control community. Since 
the pioneers works of Anderson [3] and Moore [21] , this concept has been successfulUy 
used in a large variety of fields of application going from economics |2], [13], to 
adaptive or learning control [12], [16], [22], [23], or mechanical engineering and 
robotics [T], [T3], and [20] • In this paper, we use a persistently excited adaptive 
tracking control in the multidimensional ARX framework. It allows us to avoid the 
strong controllabihty assumption recently proposed by Bercu and Vazquez [8], [9]. 
More precisely, we shall establish the almost sure convergence for both least squares 
(LS) and weighted least squares (WLS) estimators of the unknown parameters of 
ARX model. The asymptotic normality as well as a law of iterated logarithm are also 
provided. Consider the (i-dimensional autoregressive process with adaptive control 
of order {p, q), ARXrf(p, q) for short, given for all n > by 

(1.1) A{R)X^^, = B{R)Un + Sn^i 

where R stands for the shift-back operator and V„, Un and £„. are the system output, 
input and driven noise, respectively. The polynomials A and B are given for all z G C 
by 

A{z) = h-Aiz 

B{z) = h + Biz + --- + Bqz\ 
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where Ai and B.j are unknown square matrices of order d and is the identity 



matrix. Relation (1.1) may be rewritten in the compact form 



n+1 



where the regression vector $„ = (X^, f/^_i) with 



and the unknown parameter 9 is given by 

6^ = (^1, • • • , ^p, -Bi, • • • , Bq). 

In all the sequel, we shall assume that the driven noise (£„) is a martingale difference 
sequence adapted to the filtration F = (^„) where Tn stands for the a-algebra of 
the events occurring up to time n. Moreover, we also assume that, for all > 0, 
E[£:„+i£:^_^]^|jF„] = V a.s. where F is a positive definite deterministic covariance 
matrix. In addition, we suppose that the driven noise (e„) satisfies the strong law 
of large numbers i.e. if 



;i.3) r„ = i$:--' 



n 

k=l 



n 



then the sequence (r„) converges to V a.s. That is the case if, for example, (£„) is 
a white noise or if isn) has a finite conditional moment of order > 2. 



The paper is organized as follows. Section 2 deals with the parameter estima- 
tion and the persistently excited adaptive tracking control. Section 3 is devoted 
to the introduction of the Schur complement approach together with some linear 
algebra calculations. In Section 4, we propose some usefuU almost sure convergence 
properties together with a central limit theorem (CLT) and a law of iterated loga- 
rithm (LIL) for both LS and WLS estimators. Some numerical simulations are also 
provided in Sections. Finally, a short conclusion is given in Section 6. 



2. Estimation and Adaptive control 

In the ARX tracking framework, we must deal with two objectives simultaneously. 
On the one hand, it is necessary to estimate the unknown parameter 9. On the other 
hand, the output (X„) has to track, step by step, a predictable reference trajectory 
(xn). First, we focus our attention on the estimation of the parameter 9. We shall 
make use of the WLS algorithm which satisfies, for all n > 0, 

(2.1) 9n+i = 9n + anS~\a)^n -Un- ^>„)* 

where the initial value 9q may be arbitrarily chosen and 

n 
k=0 
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where the identity matrix with 6 = d{p + q) is added in order to avoid the useless 
invertibihty assumption. The choice of the weighted sequence (a„) is cruciaL If 

a„ = 1 

we find the standard LS estimator, while if 7>0, 

/ 1 \i+7 ^ 
a„=(- j with Sn= y J\^k 



k=0 

we obtain the WLS estimator introduced by Bercu and Dufio [3], [0]. Next, we 
are concern with the choice of the adaptive control sequence (Un)- The crucial role 
played by Un is to regulate the dynamic of the process by forcing Xn to track 
a predictable reference trajectory We propose to make use of the persistently 
excited adaptive tracking control given, for all n > 0, by 

(2.2) f/„ = Xn+l - $n + 

where (^n) is an exogenous noise of dimension d, adapted to F, with mean and 
positive definite covariance matrix A. In addition, we assume that (^„) is indepen- 
dent of {Sn), of (x„), and of the initial state of the system. Moreover, we suppose 
that (^ri) satisfies the strong law of large numbers. Consequently, if 



1 " 

(2.3) A„ = - V(£fe + efc)(£fc + e 



... ... .fc/ 

n 

k=l 



then the sequence (A„) converges to F + A a.s. By substituting (2.2) into (1.2), we 
obtain the closed-loop system 

(2.4) Xn+l — Xn+1 = Vr„ + En+l + C,n+1 

where the prediction error 7r„ = (^ — ^„)*$„. Furthermore, we assume in all the 
sequel that the reference trajectory (x„) satisfies 

n 

(2.5) II Xk |p= o{n) a.s. 

fc=i 

Finally, let (C„) be the average cost matrix sequence defined by 



1 " 



n 

k=l 



The tracking is said to be residually optimal if (C„) converges to F + A a.s. 

3. On the Schur Complement 

In all the sequel, we shall make use of the well-known causality assumption on B. 
More precisely, we assume that for all z G C with |2;| < 1 

(3.1) <lei{B{z)) ^ 0. 

In other words, the polynomial (\.ei{B{z)) only has zeros with modulus > 1. Conse- 
quently, if r > 1 is strictly less than the smallest modulus of the zeros of dei{B{z)), 
then B{z) is invertible in the ball with center zero and radius r and B~^{z) is a 
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holomorphic function (see e.g. [H] page 155). Hence, for all z G C with |2;| < r, we 
have 



(3.2) 



k=0 



where all the matrices Dk can be explicitly calculated via the recursive equations 
Do = Id and, for all /c > 1 



(3.3) 
(3.4) 



Y,DjBk-j if k<q, 

j=0 

Dk-jBj if k > q. 



In a similar way, for all 2; G C such that \z\ < r, we shall denote 

00 

(3.5) P{z) = B-\z){A{z) - h) = J^Pfc 



k=l 



All the matrices may be explicitly calculated as functions of the matrices Ai and 
Bj. As a matter of fact, for all /c > 1 



fc-i 



(3.6) Pk = -Y^D,Au-j if k<p, 

j=0 

p 

(3.7) Pk = -Y,Dk~,A, if k>p. 

i=i 

For all 1 < 2 < g, denote by Hi be the square matrix of order d 

00 00 



k=i 



k=i-l 



where, for all k > 0, Qk = D^ + Pk with Qo = Id. In addition, let H be the 
symmetric square matrix of order dq 



(3.^ 



H 



( Hi H2 ■ ■ ■ -ffg-l Hg \ 

H\ Hi H2 ■ ■ ■ Hq^i 



Hg_i ■ ■ ■ H\ Hi H2 
\ HI HI, ... Hi Hi J 
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For all < i < p - 1, let Ki = P^F + QiA with Kq = A and denote by K the 
rectangular matrix of dimension dq x dp given, if p > q, by 



/ Ko K, K2 
Ko K, 



K 



while, if p < g, by 



K 



p-2 
p-3 



Kp-1 \ 



K 



p-2 








Ko K, K2 
■■■ Ko K, 



K 



p-q+l 



K 



p-q 



( Ko Ki 



K 



p-2 



Kp-1 \ 






Ko 


Ki 




Kp^2 










Ko 


Ki 































K 



\ 

Finally, let L be the block diagonal matrix of order dp 

( F + A ■■■ \ 

F + A ■■■ 



(3.9) 



v 








F + A 
■■■ F + A ) 

Denote by A the symmetric square matrix of order 5 
(3.10) A = ( ^. ^* 

This lemma is the keystone of all our asymptotic results. 



Lemma 3.1. Let S be the Schur complement of L in A 

(3.11) S = H - KL-^KK 

If B is causal, then 5* and A are invertible and 

' L-^ + L-^K'S-^KL-^ -L-^K'S-^ 
-S-^KL-^ S-^ 



(3.12) 



A-i: 



Proof. The proof is given in Appendix A. □ 

Remark 3.1. One can see the usefulness of persistent excitation in ARX tracking. As 
we make use of a persistently excited adaptive tracking control given, it is possible 
to get ride of the strong controllability assumption recently proposed by Bercu and 
Vazquez [S], [H]. On the other hand, we will see in the next section that the tracking 
is not optimal but it is residually optimal. It is necessary to make a compromise 
between estimation and tracking optimality. 
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4. MAIN RESULTS 

Our first result concerns to the a.s. asymptotic properties of tfie LS estimator. 

Theorem 4.1. Assume that B is causal and that has finite conditional moment 
of order > 2. Then, for the LS estimator, we have 

(4.1) hm— = A a.s. 

n—>oo n 



where the limiting matrix A is given by (3.10). In addition, the tracking is residually 
optimal 

(4.2) ||c„-A„||=of^^ a.s. 



n 



Finally, 6'„ converges almost surely to 9 
(4.3) \\e,,-e\\''=o(^^\ a.s. 



n 

Proof. The proof is given in Appendix B. □ 

Our second resuh is related to the almost sure properties of the WLS estimator. 

Theorem 4.2. Assume that B is causal. In addition, suppose that either (e„) is a 
white noise or {sn) has finite conditional moment of order > 2. Then, for the WLS 
estimator, we have 

(4.4) lim(logn)^+^^^^ = A a.s. 



where the limiting matrix A is given by (3.10). In addition, the tracking is residually 
optimal 

(4.5) II C„ - A„ 11= o a.s. 

Finally, On converges almost surely to 9 

(4.6) II ^„ - ^ f = O (^^^^^) 

Proof. The proof is given in Appendix C. □ 

Finally, we present the CLT and the LIL for both LS and WLS estimators. 

Theorem 4.3. Assume that B is causal and that (e„) and (^„) have both finite 
conditional moments of order a > 2. In addition, suppose that (x„) satisfies for 
some 2 < P < a 

n 

(4.7) Yl II 11''= 

k=l 
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Then, the LS and WLS estimators share the same central limit theorem 
(4.8) y/^iOn-e) ^M{0,A-^(g)T) 



where the inverse matrix is given by (3.12) and the symbol ® stands for the 
matrix Kronecker product. In addition, for any vectors u E M.'^ and v G M.^ , they 
also share the same law of iterated logarithm 

f n V'^ ^ f n V'^ ^ 
limsup — — v\en - e)u = -liminf — — , v^On - 9)u 

n^oo V2l0gl0gn/ n^oo \21oglog?2/ 

/ \ 1/2 / \ 1/2 

(4.9) = (v'A~^v] (u'Tu) a.s. 

In particular, 

A™,™r \ ^ j.^^^^ / n \ II _ ^ ||2^ / A™^\ ^^^^ 



^^maxAj n^oo \2\og\ogn J 

where XmirJ' o^nd Xmax^ cire the minimum and the maximum eigenvalues ofT. 
Proof. The proof is given in Appendix D. □ 

5. NUMERICAL SIMULATIONS 

The goal of this section is to illustrate via some numerical experiments the main 
results of this paper. In order to keep this section brief, we consider a causal 
ARXd{p,q) model in dimension d = 2 with p = 1 and g = 1. Moreover, the 
reference trajectory (x„) is chosen to be identically zero and the driven and exoge- 
nous noises (e„) and (^„) are Gaussian A/'(0, 1) white noises. Finally our numerical 
simulations are based on M = 500 realizations of sample size N = 1000. Consider 
the ARX2{1,1) model 

where 

A /^20\ J „ 1/3 
^ = ^ J ^=4^0-2 

First of all, it is easy to see that this ARX2{1, 1) process is not strongly controllable 
[H], [S], because det(74) = 0. Consequently, if we use an adaptive tracking control 
{Un) without persistent excitation (^n), then only the matrix A and the first diagonal 
term of the matrix B can be properly estimated as one can see in Figure 1. 
Next, we make use of the persistently excited adaptive tracking control given by 

For all A; > 1, we have Dk = {—B)^ and Pk = —{—B)'''^A which clearly implies 
that 

Qk = -{-B)>'-\A + B). 
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Figure 1. Almost Sure Convergence 
Since the matrices A and B are both diagonal, we find that 

oo oo 
k=l k=0 

OD OO 



k=l 



k=l 
oo 



h + {A^ + {A + Bf)Y,B^\ 



k=0 

2\IT d2n-1 



= h + {A^ + {A + Bf){h-B 
Consequently, we obtain that 



H 



21 



576 
28 



Therefore, the limiting matrix A given by (3.10) is 



A 



21 



/ 42 21 \ 

42 21 

21 576 

y 21 28 y 
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It is not hard to see that det(A) = 89.7619. One can observe in Figure 2 the almost 
sure convergence of the LS estimator 6^ to the four diagonal coordinates of 0. One 
can conclude that On performs very well in the estimation of 9. 

Almost syiemieigence III A 

2,5 
2 

1,5 

1 

0,5 


-0,5 

too 200 300 m 500 600 M 800 900 1000 
Almost syiemBjeiice tor B 

1 



0,5 


-0,5 
-1 

too 200 300 400 500 600 70O 800 900 1000 

Figure 2. Almost Sure Convergence 
Figure 3 shows the CLT for the four coordinates of 

Zn = VNA^/\eN -0). 

One can realize that each component of Z^- has A/'(0, 1) distribution as expected. 

6. CONCLUSION 

Via the use of a persistently excited adaptive tracking control, we have shown that 
it was possible to get ride of the strong controllability assumption recently proposed 
by Bercu and Vazquez [H], [9]. We have established the almost sure convergence for 
the LS and WLS estimators in the multidimensional ARX framework. In addition, 
we have shown the residual optimality of the adaptive tracking. Moreover, both 
LS and the WLS estimators share the same CLT and LIL. We hope that similar 
analysis could be extended to the ARMAX framework. 
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Central Limit Theorem for A 
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Central Limit Theorem for B 
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Figure 3. Central Limit Theorem 
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Appendix A 

PROOF OF LEMMA O 
Let A and B be the infinite-dimensional diagonal square matrices given by 

/ F \ 



A 



F 
■■ F 



v ■■■ 

/ A 





B 




A 





A 



v 



\ 



Moreover, denote by V and Q the infinite-dimensional rectangular matrices with dq 
rows and an infinite number of columns, respectively given, if p > q, by 



V 



Q 



while, if p < q, by 



V 



Q 



1 Pp 


Pp+i 




Pk 


Pk+l 


" \ 


Pp^ 


1 Pp 




Pk-l 


Pk ■ 




p 

J- p-q 


+2 Pp- 


-q+3 




^k-q+2 


^k~q+Z ■ 




\ Pp-q 


+1 Pp- 


-q+2 




Pk-q+1 


Pk-q+2 ■ 


/ 


( Qp 


Qp+1 






Vfc+1 


■ ■ ^ 


Qp~ 


1 Qp 




Qk-l 


Qk 




Qp-q+2 Qp- 


-g+3 




Qk~q+2 


Qk-q+3 




\ Qp-q- 


fi Qp' 


-q+2 




Qk~q+l 


Qk~q+2 


■ / 


1 Pp 


Pp+i 






Pk 


Pk+l 


■ \ 


Pi 


P2 






Pk-p+l 


Pk-p+2 ■ 







Pi 


P2 




Pk—p 


Pk-p+l ■ 




V 









Pi 


P2 ■ 


■ / 


/ Qp 


Qp+i 






Qk 


Qk+1 


■ \ 


Qi 


Qi 






Qk-p+l 


Qk~p+2 ■ 




Qo 


Qi 


Q2 




Qk~p 


Qk-p+l ■ 







Qo 


Qi 




Qk—p—l 


Qk—p 




V 









Qo 


Qi ■ 


■ / 
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Furthermore, let S 
of order dp 



A- A(r 

/ 

c = 

V 



A) ^A and denote by C the block diagonal matrix 
•• 

















\ 

















One can observe that S is a positive definite matrix. Finally, if p > q, denote by V 
the matrix with dq rows and dp columns given by 

/ Do 



V 







Do 



D2 

Di 



Dp-2 



D 



p~3 



n 

D 



p-2 



\ 








Dn 



Di 
Do 



D2 

Di 



D 



p-q+l 
Dp-q 



\ 



J 



while, if p < g, the upper triangular square matrix of order dp given by 



V 



( Do 




V 







■■■ 

Do D, 
... 



D 



p-2 







Dp-i \ 



D 



p-2 



Dn 



J 



On the one hand, if p > q, we can deduce from (3.11) after some straightforward, 
although rather lengthy, linear algebra calculations that 

(A.l) S = VAV' + QBQ' + VCV'. 



We shall focus our attention on the last term in ( A.l ). Since the matrix C is positive 
definite, it immediately follows that VCV^ is also positive definite. Consequently, 
the Schur complement S is invertible. On the other hand, if p < q, we can see from 

R. 



KTl\ that 



S = VAV' + QBQ' 
where R is the symmetric square matrix of order 

VCV O 



R 



O* W 



where O stands for the zeros matrix of order dp x d{q — p) and W is the block 
diagonal matrix of order d{q — p) 

/A ■■■ 

A 



W 











\ 





v 
















A 





A 



Taking into account the fact that VCV^ and W are both positive definite matrices, 
we obtain that R is also positive definite which implies that S is invertible. Finally, 
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we infer from (3.10) that 
(A.2) 



det(A) = det(L) det{S) = det{T + Aydet{S). 



Consequently, we deduce from (A.2) that A is invertible and formula (3.12) can be 
found in [19] page 18, which completes the proof of Lemma 3.1 □ 



Appendix B 
PROOF OF THEOREM O 



In order to prove Theorem |4.1[ we shall make use of the same approach than 
Bercu ^ or Guo and Chen |17j. First of all, we recall that for all n > 



(B.l^ 



It follows from (B.l) together with the strong law of large numbers for martingales 



(see e.g. Corollary 1.3.25 of |14jj) that n = 0{sn) a.s. Moreover, by Theorem 1 of 
[7] or Lemma 1 of [T7], we have 



(B.2) 



J2i^-fk)Ukf=0{logSr.) a.s. 



fe=i 



where = $^S'„^$„. Hence, if (£„) has finite conditional moment of order a > 2, 
we ca n show by the causality assumption on the matrix polynomial B together with 
( |R2| ) that II $„ f = C(s^) a.s. for all 2a-^ < /3 < 1. In addition, let = <i>l^S~\<l>n 
and 6n = tT{S~\ — S:^^). It is well-known that 

(l-/„)(l+^7n) = l 

and (5„) tends to zero a.s. Consequently, as 

l + gn<2 + 6n\\^n f, 



we infer from from (B.2) that 

n 

(B.3) 

k=l 



TTfc 



o(s(^logs„) a.s. 



Therefore, we obtain from (2.5), (B.l) and (B.3) that 

n 

(B.4) Yl II ^k+i f = o(s^ log Sn) + 0{n) a.s. 

k=l 



Furthermore, as B is causal, we find from relation ( 1.1[ ) that 
(B.5) Un = B-\R)A{R)Xn+i - B-\R)en+i 



which implies by (B.4) that 

n 

(B.6) Yl II ^'^ 



o{s^logSn) + 0{n) a.s. 



k=l 
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It remains to put together the two contributions (B.4) and (B.6) to deduce that 
Sn = o{sn) + 0{n) a.s. leading to s„ = 0{n) a.s. Hence, it follows from (B.3) that 



(B.7) 



E 

k=l 



TTfc = oin a.s. 



Consequently, we obtain from (2.5), (B.l ), (B.7) and the strong law of large numbers 
for martingales (see e.g. Theorem 4.3.16 of [14j) that 

1 

lim - VXfcX* =r + A 

n^oo n ^ 



a.s. 



k=\ 



and, for all 1 < i < p — 1, 

which implies that 
(B.8) 



om a.s. 



fc=0 



1 " 

k=\ 



where L is given by (3.9). Furthermore, it follows from (1.1), (B.l) and (B.5) that 
for all n > 

C/„ = S-i(i?)A(i?)X„+i-5-i(i?)£„+i, 



where 



K = fi-^(i?)A(i?)(7r„ + x„+i), 
= P(i?)£„,+i, 



Consequently, we deduce from the Cauchy-Schwarz inequality together with (2.5), 
(B.7), and the strong law of large numbers for martingales (see e.g. Theorem 4.3.16 
of [H]) that for all 1 < i < g 

1 " 

lim - UkUl^i^^ = Hi a.s. 

k=l 

which ensures that 

(B.9) lim -J2umY = H a.s. 

n— >oo 77, ' 



k=l 



where H is given by (3.8). Via the same lines, we also find that 

1 " 

(B.IO) lim-J2xm-iY = K' a.s. 

n^oo "77 ' 



k=l 
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Therefore, it follows from the conjunction of (B.8), (B.9) and (B.IO) that 



(B.ll) 



lim 

n^oo n 



A a.s. 



where the limiting matrix A is given by (3.10). Thanks to Lemma 3.1, the matrix 
A is invertible. This is the key point for the rest of the proof. On the one hand, it 
follows from (B.ll) that n = 0{Xmin{Sn)), \\ $n |P= o{n) a.s. which implies that 
tends to zero a.s. Hence, by ( |B.2[ ), we find that 



(B.12) 



E 

k=l 



TTfe 



O(logn) a.s. 



On the other hand, we obviously have from ( |B.1[ ) 



(B.13) 



n ^ 

k=l 



a.s. 



Consequently, we immediately obtain the tracking residual optimality (4.2) from 
(B.12) and (B.13). Furthermore, by a well-known result of Lai and Wei j2I] on the 
LS estimator, we also have 



(B.14) 



dn+l — d 



o 



a.s. 



Hence (|4.3|) clearly follows from (B.ll) and (B.14), which completes the proof of 

□ 



Theorem 14. 1[ 



Appendix C 

PROOF OF THEOREM US 
By Theorem 1 of [H], we have 



(c.i: 



^a„(l - /„(a)) II 7r„ f < +00 a.s. 



n=l 



where the coefficient /n(a) = an^\iS^^{a)(^n- Then, as the weighted sequence (a„ 
is given by 

a„ = I 

log Sr. 



1+7 



with 7 > 0, we clearly have = 0(s„) a.s. Hence, it follows from (C.l) together 
with Kronecker's Lemma given e.g. by Lemma 1.3.14 of [14j that 



(C.2) 



E 

k=l 



OiSr. 



a.s. 



Therefore, we obtain from (2.5), (B.l), (C.2) and the strong law of large numbers 
for martingales (see e.g. Theorem 4.3.16 of \}Ai) that 

n 

(C.3) 5^ II Xfc+i f = o(s,„) + 0(n) a.s. 

k=l 
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In addition, we also deduce from the causality assumption on the matrix polynomial 
B that 

n 

(C.4) 5^ II f/, f = o(s„) + a.s. 

k=l 



Consequently, we immediately infer from (C.3) and (C.4) that s„ = o{sn) + 0{n) so 
Sn = 0{n) a.s. Hence, (|C.2[) implies that 



(C.5) 



II TTfc ||^= o{n) a.s. 



k=l 



Proceeding exactly as in Appendix A, we find from (C.5) that 

lim — = A a.s. 

n— >cxD fl 

Via an Abel transform, it ensures that 



(C.6) 



lim (logn 



1 1+7 



Sn(a) 



A a.s. 



n 



We obviously have from (C.6) that /n(a) tends to zero a.s. Consequently, we obtain 
from (C.l) and Kronecker's Lemma that 



(C.7) 



k=l 



o((log Sr. 



a.s. 



Then, (4.5) clearly follows from (B.13) and (|C.7|). Finally, by Theorem 1 of [6] 

ef=o 



{CI 



e. 



n+l 



a.s. 



Hence, we obtain (4.6) from (C.6) and (C.8), which completes the proof of Theorem 

m 



□ 



Appendix D 
PROOF OF THEOREM lOl 



First of all, it follows from (|1.2|) and (|2.1|) that for all n > 1 
(D.l) 
where 



e^-e = s-\{a)Mr,{a) 



(D.2) 



fc=l 



We now make use of the CLT for multivariate martingales given e.g. by Lemma C.l 
of [7], see also [T^. On the one hand, for the LS algorithm, we clearly deduce (4.8) 
from convergence (4.1) and decomposition (D.l). On the other hand, for the WLS 
algorithm, we also infer (4.8) from convergence (4.4) and (D.l). Next, we make use 
of the LIL for multivariate martingales given e.g. by Lemma C.2 of [7], see also 
j. For the LS algorithm, since (e^) has finite conditional moment of order 
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a > 2, we obtain from Chow's Lemma given e.g. by Corollary 2.8.5 of 
all 2 < /3 < a 



that for 



(D.3) 



n 

E 

k=l 



II f= 0{n) 



a.s. 



The exogenous noise shares the same regularity in norm than which means 
that for all 2 < /5 < a 



(D.4) 



0{n) a.s. 



k=l 



Consequently, as the reference trajectory (xn) satisfies (4.7), we deduce from (B.l) 
together with ( [rI2| ), ( |d3| ) and fi^ that for some 2 < (3 < a 



(D.5) 



0{n) 



a.s. 



k=l 



Furthermore, it follows from ( |B.5[ ) and (D.5) that 

n 



(D.6) 



C(n) 



a.s. 



k=l 



Hence, we clearly obtain from (|D.5|) and (|D.6|) that 
(D.7) 



n 

E 

fc=i 



C(n) 



a.s. 



Therefore, as > 2, (ID. 71) immediately implies that 



E 

n=l 



/3 



< +00 a.s. 



Finally, Lemma C.2 of [7] together with convergence (4.1) and (D.l) lead to (4.9). 
The proof for the WLS algorithm is left to the reader because it follows essentially 
the same arguments than the proof for the LS algorithm. It is only necessary to add 
the weighted sequence (a„) and to make use of convergence (4.4). □ 

References 

[1] A. A. Abouelsoud, M. F. Hassan and M. A. Sultan, An adaptive observer for robots with 
persistent excitation, International Journal of Systems Science, Vol. 27, pp. 809-820, 1996. 

[2] E. Aggelogiannaki, P. Doganis and H. Sarimveis, An adaptive model predictive control con- 
figuration for production-inventory systems, Internationa Journal of Production Economics, 
Vol. 114, pp. 165-178, 2008, 

[3] B. D. O. Anderson, Exponential convergence and persistent excitation, 21tli IEEE Conference 
on Decision and Control, 1982. 

[4] K. J. Astrom and B. Wittenmark, Adaptive Control, 2nd edition, Addison- Wesley, New York, 
1995. 

[5] B. Bercu and M. Duflo, Moindres carres ponderes et poursuite. Annals de I'lnstitut Henri 
Poincare, Vol. 28, pp. 403-430, 1992. 



18 



BERNARD BERCU AND VICTOR VAZQUEZ 



[6] B. Bercu, Weighted estimation and tracking for ARMAX models, SIAM J. Control Optim., 

Vol. 33, pp. 89-106, 1995. 
[7] B. Bercu, Central limit theorem and law of iterated logarithm for least squares algorithms in 

adaptive tracking, SIAM J. Control Optim., Vol. 36, pp. 910-928, 1998. 
[8] B. Bercu and V. Vazquez, Further results for ARX models in adaptive tracking, 47th IEEE 

Conference on Decision and Control, 2008. 
[9] B. Bercu and V. Vazquez, A new concept of strong controllability via the Schur complement 

in adapative tracking, submitted to Automatica, 2008. 
[10] P. E. Caines, Linear Stochastic Systems, John Wiley, New York, 1988. 

[11] H. F. Chen and L. Guo, Identification and Stochastic Adaptive Control, Birkhauser, Boston, 
1991. 

[12] C. Chengyu, N. Hovakimyan and W. Jiang, Intelligent excitation for adaptive control with 
unknown parameters in reference input, IEEE Trans. Automat. Control, Vol. 52, pp. 1525- 
1532, 2007. 

[13] L. Corrado and S. Holly, The linearisation and optimal control of large non-linear rational 
expectations models by persistent excitation source. Computational Economics, Vol. 28, pp. 
139-153, 2006. 

[14] M. Duflo, Random Iterative Models, Springer Verlag, Berlin, 1997. 

[15] H. Fang, R. X. Fan, B. Thuilot and P. Marinet, Lateral control for autonomus vehicles with 
sliding angle reconstruction, Chinese Control and Decision Conference, 2008. 

[16] A. Farrell, Persistent excitation conditions in passive learning control, Automatica, Vol. 33, 
pp. 699-703, 1997. 

[17] L. Guo and H. F. Chen, The Astrom Wittenmark self-tuning regulator revisited and ELS- 
based adaptive trackers, IEEE Trans. Automat. Control, Vol. 36, pp. 802-812, 1991. 

[18] L. Guo, Self convergence of weighted least squares with applications to stochastic adaptive 
control, IEEE Trans. Automat. Control, Vol. 41, pp. 79-89, 1996. 

[19] R. A. Horn and C. R. Johnson, Matrix Analysis, Cambridge University Press, New York, 
1990. 

[20] J. T. Huang, Persistent excitation in a shunt DC motor under adaptive control, Asian Journal 
of Control, Vol. 9, pp. 37-44., 2008. 

[21] T. L. Lai and C. Z. Wei, Extended least squares and their applications to adaptive control 
and prediction in linear systems, IEEE Trans. Automat. Control, Vol. 31, pp. 898-906, 1986. 

[22] D. Levanoy, On persistent excitation conditions for the filtering of convergent semimartingales, 
43th IEEE Conference on Decicion and Control, 2004. 

[23] D. Levanoy and P. E. Caines, On persistent excitation for linear systems with stochastic 
coefficients, SIAM J. Control Optim., Vol. 40, pp. 882-897, 2001. 

[24] J. B. Moore, Persistency of excitation in extended least squares, IEEE Trans. Automat. Con- 
trol, Vol. 28, pp. 60-68, 1983. 

[25] W. F. Stout, Almost sure convergence. Academic Press, New York, 1974. 

[26] C. Z. Wei, Adaptive prediction by least squares predictors in stochastic regression models with 
applications to time series. Annals of Statistics, Vol. 15, pp. 1667-1682, 1987. 
E-mail address: Bernard.Bercu@math.u-bordeauxl.fr 
E-mail address: Victor .VazquezSsiu.buap.mx 

Universite Bordeaux 1, Institut de Mathematiques de Bordeaux, UMR 5251, 351 

COURS DE LA LIBERATION, 33405 TALENCE CEDEX, FRANCE. 



UNIVERSIDAD AuTONOMA DE PUEBLA, FACULTAD DE ClENCIAS FiSICO MATEMATICAS, AvENIDA 

San Claudio y Rio Verde, 72570 Puebla, Mexico. 



